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Abstract 

We propose a static and a dynamic approach to model biological signaling networks, and 
show how each can be used to answer relevant biological questions. For this we use the two 
different mathematical tools of Propositional Logic and Integer Programming. The power of 
discrete mathematics for handling qualitative as well as quantitative data has so far not been 
exploited in Molecular Biology, which is mostly driven by experimental research, relying on 
first-order or statistical models. The arising logic statements and integer programs are analyzed 
and can be solved with standard software. For a restricted class of problems the logic models 
reduce to a polynomial-time solvable satisfiability algorithm. Additionally, a more dynamic 
model enables enumeration of possible time resolutions in poly-logarithmic time. Computa- 
tional experiments are included. 

Key Words: biological signaling networks, modeling, integer programming, satisfiability, 
monotone boolean functions 



1 Introduction 

Cellular decisions are determined by highly complex molecular interactions. In some biological 
systems like Saccharomyces or E. coli, detailed measurements of the interacting molecules, includ- 
ing reaction kinetics, have successfully been performed, allowing the construction of quantitative 
models (jFeist et aL||2007). In many other systems such extensive measurements are not available. 



because of practical experimental restrictions or ethical constraints. However, in these cases, there 
is often still a sizable amount of qualitative information available, but a lack of suitable predictive 
modeling tools. 

We focus here on interactions in form of signal transduction processes. For such a process we 
assume that a set of molecules that are important for the biological unit is known. The biological 
unit reacts to external signals or environmental challenges like stimulation or infection. Typically, 
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the molecules may be subdivided into input components (e.g. receptors), intermediate components 
and output components (e.g. transcription factors): When an external signal arrives, this signal is 
processed through the entire unit by first influencing a subset of the input components. Activation 
state or presence/absence information is propagated through intermediate nodes towards some of 
the output molecules. Based on the assumption that we know the "local" mechanism of activa- 
tion, it is our goal to predict the global behavior of the system, identifying the underlying network 
structure. For our purposes 'activation' can mean any interaction that can be explained biologi- 
cally: A protein may be considered activated after phosphorylation, Ca+^ flux may be detected, or 
a component may change its location within the biological unit. Similarly, 'biological unit' need 
not be restricted to a single cell or compartment, but any collection of components that are to be 
considered. 

Subsequently we propose a logic and an integer programming model to analyze the static be- 
havior of signaling networks. With both approaches one is able to verify the biological modeling, 
find potential failure modes and determine suitable intervention strategies. But some phenomena 
in biological units like time delays and (negative) feedback loops can not be modeled in this static 
fashion. Thus we focus on the dynamics of signaling networks in the second part. We extend the 
previous models so that activations can be modeled as occurring at diff'erent time points or with 
different signaling speed. In this section we present a generic framework for computations with 
the dynamic model which can use solvers specific to each of the modeling techniques, logic and 
integer programming, as oracles. This ability requires a basic understanding of the transformation 
from satisfiability systems to integer programming models and vice versa. Therefore we discuss 
both sides in the static as well as in the dynamic context hand in hand. The last section provides 
computational tests showing the appropriateness of our techniques. 
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2 Modeling Logical Interactions 



The simplest model of signaling processes is to collect local data in the form of logical formulas, 



that can be written down in propositional logic (Saez-Rodriguez et al. , 2007): Introduce logical 



variables for each component under consideration, and write down implication formulas for exper- 
imentally proven knowledge statements like "MEK activates ERK" as 

MEK ^ ERK 

and "In the absence of (activated) pten and ship 1 we find that pi3k generates (active) pip3" as 

-ipten A -ishipl A pi3k pip3. 

Let the formulas be denoted as 5, with i e {1, . . . , i'}. We can then identify the formula S = 
A,Li Si with the model of the biological unit considered: All logical statements Si should be valid 
at the same time to model the global behavior of the unit. We will, as usual, use A ^ B as 
abbreviation of (-lA) V B, and A <r^ B instead of (A ^ B) A{B ^ A). For the reader unfamiliar 



with the formalism of propositional logic we refer to ( [Buning and Lettmann[[1999| ). 

We will henceforth assume that all implications in the set 5, are given in OR- form VyeL^ ~^ 
VyeL" Bj for literals Aj, Bj. Here, Lf is the set of literals appearing on the left in formula i. We will 
also require that the set S has been extended with reverse implications by first aggregating formulas 
with the same right-hand- side, and then adding the reverse implication. Thus, for each set of 
hterals R = [Bj\j e Lf for some z e {1, . . . , 5}| appearing on the right-hand- side of the implications 

indexed by / = = (V;eL^ ^7 ~^ Vres f)]^ we also find the implication Vie/ VyeL'* ^ Vres 
in S . This enforces that every activation must have a 'cause' within the given model. 

The question whether there exists a pattern of activations satisfying all formulas of S is an 



instance of the satisfiability (SAT) problem (Truemper, 2004). In general, this problem is to ask for 



a truth assignment such that the logical formula in CNF form is True: 
Definition 1 (CNF, truth assignment, satisfiable). 

1 . A clause a is a disjunction of literals, i.e. a = Ai V . . . V A„ with literals A,-. 

2. A formula a is in Conjunctive Normal Form (CNF) if and only if a is a conjunction of 
clauses. 

3. A formula a is in k-Conjunctive Normal Form (A;-CNF) if and only if or is a conjunction of 
^-clauses, i.e. every clause consists of at most k literals. 

4. A truth assignment F of a propositional formula a is defined by 

r : jc lor is a propositional formula | {0, 1} . 
It can be calculated according to three rules: 

(i) F(-Q') := l,iffT(a) = 

(ii) Tia VyS) := 1, iff F(a) = 1 or F^S) = 1 

(iii) F(a AyS) := 1, iff F(a) = 1 and Y(/3) = 1 
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5. A prepositional formula a is satisfiable if and only if there exists a truth assignment F, so 
that no-) = 1. 



Definition 2. A model m of a CNF formula C is a satisfying truth assignment of C. The set of all 
models of C are denoted by models(C). We denote that m assigns 1 (0) to variable x by m{x) = 1 
{m{x) = 0). If m(x) = 1 implies m*{x) = 1 for two models m and m*, we say that m < m*. If neither 
m < m* nor m > m* is true, the two models are incomparable. We call a model maximal {minimal) 
if there is no model m* such that m < m* (m > m*). We denote the set of all maximal (minimal) 
models of C by maximal(C) (minimal(C)). 

Problem 1 (SAT). Given a CNF (3-CNF) formula C, the SAT (3-SAT) problem is to decide if C is 
satisfiable and, if so, to return a possible model. 

In the setting of SAT problems we can also answer the question whether, given a partial set of 
activations, there exists a solution for the entire formula 5, by fixing some logical variables in S 
to the prescribed values and solving the SAT problem for the remaining formula S'. We are thus 
prepared to introduce the signaling network satisfiability problem (IFFSAT) as: 

Problem 2 (IFFSAT). Let 

S ={Si = yjeLfAj^yj,LsBj} 

be a set of 5 = |5| equivalence formulas over the literal set L, and Lq, Li c L two sets of variables 
to be fixed. An instance of the IFFSAT problem is of the form 

s 

/\SiA/\ i^x) A /\x. (IFFSAT) 

(=1 xeL(t xeL[ 

Much research has been done to find effective solution algorithms for subclasses of 
SAT ( Truemper| |2004[ ). There is, however, no algorithm that can efficiently (Garey and Johnson 



1979p check satisfiability for arbitrary propositional formulas, as we have to consider for this ap- 



plication: 



Lemma 1. The satisfiability problem for problems of the form ( |IFFSAT[ ) is equivalent to 3-SAT, 
hence NP-complete. 

Proof. We only need to show that 3-SAT instances can be written in IFFSAT form. Using » to 
designate logical equivalence this can be seen as follows: 

w ^{xi V x^ m{) a y\(M{ V x^ A y\ 

jel jel jel 

This is an instance of IFFSAT form in which at most 2 \I\ literals and 2 \I\ propositional formulas 
were added. □ 
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Figure 1 : A small signaling network from Example [T] The dashed lines denote inhibition while 
the black node means a logic and. 



As already known to Dantzig ( |Dantzig[ |1963| ), SAT problems can be formulated as integer 
programs, i.e. feasibility or optimization problems over linear systems of inequalities, where the 
solutions are required to be integral. For an overview of this field see ( Bertsimas and Weismantel[ 
2005 p . For the IFFSAT problem the associated integer program (IP) is constructed by introducing 
\L\ binary variables xi and their complements xi, and translating each IFF formula into the system 

eS,keLf 



Z JeLf ^Aj - Xbi^ > 

-XAj + ZkeLf ^B, > 

xi + Xi =1 

Xp — 1 , Xq — 



for all Si 
forall5, e 5, J eLf 
I 6 L 
p £ Li,q e Lo 



(1) 



where we will assume that for non-negated literals A e L the variable xa, and for negated literals 
-lA e L, Xa has been used in the formulation of the inequalities. 

Remark 1. The integer programming formulation ([T]) of ( |IFFSAT[ ) has the form of a generalized set 
cover problem 



A;c > 1 - n(A), x e {0, 1} , 
where n(A) is the number of negative entries in the corresponding row of A. 

We illustrate the presented methods with the help of a small example. 
Example 1. The inequality description to the network shown in Figure [T] reads 



(2) 



{\ - Xa) + {I - Xb) 
(1-^a) 
{1-Xb) 
xc 

Xp 



> (1 - Xd) 

< (1 - Xd) 

< (1 - Xd) 

= Xe 
= Xg 
^/6{0,1}V/ 



Xd + Xe > Xp 

Xd < Xp 

Xe ^ Xp 

(1 — Xg) = Xd 

Xg = xh 



(3) 
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Several scenarios can be tested with these inequalities. First of all certain input and output patterns 
can be checked for validity. For this purpose fix xa, Xb, Xq and xu to the desired value and solve 
the IP with arbitrary objective value. If it is feasible, the input/output pattern is a valid assignment. 
If one is interested in the output of the network for a prescribed input pattern, one fixes the inputs 
to interesting values again and solves the IP with the objective to maximize xr. The returned 
objective value is the value of H. In the example the input pattern jc^ = 0, JCg = 1, = gives and 
output Xu= \- 

Another issue for modeling signaling networks is to check the completeness of the model. This 
can be done by checking whether the set described by the inequalities ([3]) contains feasible points. 
Our example is feasible, as the point {xa-,xb, xc,xd,xe,xf,xg,xh) = (1, 1,0, 1,0, 0,0, 0) is valid. 

Potential failure modes and corresponding suitable intervention strategies can be found by 
testing knock-in/knock-out scenarios and checking if this forces other variables to obtain a specific 
value. Knock-in/knock-out scenarios are done by fixing various variables to a desired value. To test 
whether other variables are thereby fixed, we solve different IPs. Two IPs are needed for checking 
if two variables have a certain value. In our example we set xe = and x// = 1. To check whether 
e.g. xd and xa need to be fixed, we solve the IP with the objective function xd + xa- The solution is 
1 and the variables are = and = 1 . Thus, we know that xd must have the value 0. Another 
optimization problem with the objective to minimize Xa gives the solution 0, and thus xa is not 
necessarily 1 but can have both values. 
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3 Some Complexity Results for IFFSAT 



The IFFSAT problem becomes easier if certain structural properties are fulfilled, as has been shown 
in ( Haus et aL| 2007| ). From now on we will restrict the signaling networks to equivalence formulas 
with only one literal on the right-hand- side, i.e. |Lf | = 1 V?, unless it is explicitly stated differently. 

Initially we have to transform IFFSAT to a special form that allows us to perform the subsequent 
analysis. 



Definition 3 (cascade form). A signaling network ( |IFFSAT| ) is called in cascade form if for all 
clauses 5,- it holds that \Lf\<2 and \Lf\ = 1. 

Remark 2. Any signaling network can be transformed to cascade form by introducing additional 
literals and equivalence clauses. Indeed, this can be achieved by recursively applying the following 
replacement: 



gets replaced by 
and 



5; = {Ai VA2 ^ C} 
^:' = {(V;aAU,2,A,)vC^5) 



where C is a new literal. 

Secondly we will review some notation from logic. 

Definition 4. Let 5 be a 3-CNF formula. The undirected graph G(S) is defined by the variables of 
S as its nodes and for every 2-clause of S there is an edge between the corresponding nodes. 

Definition 5 (cutnode, cutnode condition). 

1. Let a, b and c be nodes of a graph. We call c an a/b cutnode if removing c from the graph 
disconnects the nodes a and b. 

2. An IFFSAT instance S in cascade form fulfills the cutnode condition if for every equivalence 
formula 5,-, 5,- is an Ai,/A2, cutnode in G(S). 

After IFFSAT is transformed to cascade form, the cutnode condition can easily be checked by 
computing the connected components of G(5). In ( Haus et aL| 2007) it is proved that 

Theorem 2. If an instance of IFFSAT in cascade form satisfies the cutnode condition, it can be 
solved in linear time. 

The cutnode condition is a restriction to realistic networks but the following example shows 
that, e.g., feedback loops do not in general contradict the condition. 

Example 2. The network defined by 

formula 2-clause(s) 

Ay B -.A V C, -.5 V C 

D -.A V D 

E -.D V £■ 
^ A Ey A 
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Figure 2: Graph of the network from Example |2] 



shown in Figure |2] has a cycle with an odd number of negations, but satisfies the cutnode 
condition (there is one equivalence formula, and its output C is a cutnode). 

For the inequality description ([T]) some nice polyhedral properties can be obtained. One of 
them is unimodularity ( Bertsimas and Weismantelj [2005 ), which leads to integral relaxations of 
the polyhedron, for the smallest nonempty IFFSAT problems. 

Definition 6 (unimodularity). A matrix A 6 Z'"^" of full row rank is unimodular if the determinant 
of each basis of A is + 1 . 

Lemma 3. The submatrix of a single equivalence clause S j in the IP model Q is unimodular if 
the set Lf has cardinality 2 and Lf has cardinality 1. 



atoms A,B,C. The matrix U = 



is clearly unimodular. Hence, M = | ^ ^j, where 



Proof. Consider the case where the formula considered is exactly A V 5 C with non-negated 

1 1 -1 
-1 1 
-1 -1 , 
1 denotes a 3 x 3 unit matrix, is unimodular. 

All other cases arise from M by unimodular row operations, i.e. subtracting the complemen- 
tarity constraint in the top 3 rows. □ 

Even for the simple formulas (A V 5) (C V D) as well as (A V 5 V C) Z), the inequality de- 
scription ([T]) is non-unimodular. However, the linear relaxation of ([T]) for one equivalence formula 
with arbitrary large Lf and Lf is still integral: 

Lemma 4. The inequality description of a single equivalence clause S , in the IP model Q is 
integral. 



Proof See (Hooker, 2007 p. 338). □ 



These integrality results cannot be generalized to IFFSAT problems with an arbitrary number 
of equivalence formulas, as the next example shows. 

Example 3. We consider a set of two equivalences that model a small negative feedback cycle, i.e. 

S = {{Xi V ^3 xa) a {x2 y Xa, x^)} . 
The integer programming formulation from ([T]) has the following LP relaxation: 
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Xi+Xj-X4> X2-Xj+X4.> 

-Xl +X4> -X2+X3 > 

-X3+X4> +X3-X4> 

X, + X, = 1 , < X; < 1 . 

Computing the vertices we find both integral and fractional points: 
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1. 



It should be noted that not all vertices are fractional, which means that this SAT instance is not 
infeasible. 
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4 Dynamics of Signaling Networks 



In practical applications signaling networks often turn out to be infeasible. This is not reasonable 
in a biological sense, but it can occur due to delayed reactions modeled as instantaneous, or due 
to modeling errors. Especially (negative) feedback loops with time delays make the static models 
infeasible, but at the same time have a huge impact on the functionality of a signaling network since 
certain activation cascades can be enabled initially and switched off at a later time point to avoid 
overreaction. In order to model the dynamics of a signaling network we introduce an extension of 
IFFSAT, the requirement IFFSAT problem. 

Problem 3 (RIFFSAT). Let a set i? of r = \R\ equivalence formulas of the form 

R = [Ri = VjeLfiAj A yj) ^ {Bt A v,eLf yj)} (4) 

over the literal set L U F be given, where Y is the set of requirement variables. Let Lq, Li Q LU Y, 
sets of fixings, be given, then the RIFFSAT problem is to find a satisfying solution of 

r 

/\ Ri A /\(^x) A /\x. (RIFFSAT) 

('= 1 xeLo xeLi 

In the signaling network context yj = 1 denotes influence of the corresponding component Aj 
on the right hand side while yj = denotes no effect. In case yj = for all j e Lf, we request 5, 
to be free. 

Remark 3. We ask the requirement variable yj of Aj to be the different for every IFF formula in 
which Aj occurs on the left hand side, and to be equal to V/teL^ yt if is the right hand side of 
clause R:. 



We denote by T the set of all 0/1-points for which ( |RIFFSAT[ ) is True, i.e. 

r = lxe {0, 1}2I^I I r(ALl R, A A^eLoi^ x) A A.veL . X) =1). 

Usually one is interested in solving ( [RIFFSAT} with special properties on the set of requirement 
variables y'j, like a maximal or minimal models over y. Such a problem can be solved by a variation 



of SAT, namely MAXVAR SAT (see (ITruemper[|2004|)). Here a satisfiable CNF system C and a set T 



with True/False fixings of a variable subset is given, such that C is not satisfiable if all variables are 
fixed according to T. The task is to determine a maximal subset T* of T so that C is satisfiable. In 
our setting T can be {ji = . . . = y\L\ = True}. MAXCLS SAT is also a related problem. We remark 
that both problems are special cases of MAXSAT, which can not be approximated polynomially 



better than 8/7 (Hastad, 2001 ) and hence it is NP-complete. 



Besides the presented method from logic one can also find a maximal solution with the help of 
integer programming techniques. 

Lemma 5 (inequality description for RIFFSAT). Given one equivalence formula Ri e R as in Q, 
introduce n,- = \Lf\ additional binary variables Yi = {Xy^, . . . , JCy,, • Then the corresponding set of 
feasible points Tr. can be described by + • 2"'"^ inequalities plus binary constraints of the 
form: 

xb, >XAj-{\-Xy) jeLf 
Xb, < ZkeS XAt + (1 - Xy) + Y,us Xy, j £ S , d) S Q Lf 
Xl 6 {0,1} ^ 

1 =x, + x, ULfu{Bi}UYi 
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XAj • • • Xa„ XBf Jl yi J3 • • ■ Jn 
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1 1 •• 


• 








1 1 


... 1 



Table 1: 2n + \ linearly independent points for xb, > xa^ - y\- 



We will assume that xi is used in the inequality description if the corresponding atom is negated. To 



derive the inequality description for (RIFFS AT), introduce such inequalities for all Ri, i = \, . . . ,r, 



and fix the variables according to Lq and L\. 

Remark 4. Note that this formulation still preserves the form of a generalized set covering problem. 
In addition, for each fixed Xy the formulation reduces to an instance of ([1]). 

Maximizing the sum over all requirement variables Xy. yields one maximal feasible solution. 
However, there are many inequalities needed to describe the feasible points. It turns out that all of 
them are needed: 

Lemma 6. The inequalities for a single relaxed equivalence clause (|5]) are facets for the convex 
hull of their integral points 'F. 

Proof. We will show that for every inequality there exist dim(conv(!F)) = 2n+l affine independent, 
integral points fulfilling the corresponding inequality with equality, where n = \Lf\. 

XBf > XAj - {I - yj). For reasons of symmetry we restrict the analysis to j = 1. The 2n + I 
linearly independent points are displayed in Table [T] 

^B, < ZjeS ^Aj + (1 - J/) + ZjiS yf- 

For an easier notation, let us assume that the first k indices belong to the selected set S and Z = 1 . 
In Table |2] the linearly independent points are presented. 

This concludes the proof. □ 

Lemma [6] thus implies that the inequalities that are needed to describe conv(;F) definitely in- 
clude all constraints in (|5]). Hence, the number of inequalities is exponential in the number of 
inputs of the clause. This motivates to explore alternative, extended formulations for modeling T 
based on a cascade representation of their underlying IFFSAT instance. 

Lemma 7. Each RIFF SAT instance can be transformed to cascade form. 
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Table 2: 2n+ 1 linearly independent points for jcg, < Yij^s + ( 1 +2 j^s with S = {\,.. .,k}. 
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The recursive construction is analogous to the IFFSAT case, handling each conjunction as one 
literal and introducing variables of j-type for the artificial variables. 

Although transforming the RIFFSAT instance to this specific form leads to more variables and 
equivalence formulas, the growth of the instance is only quadratic. Recall that r = \R\ and let n be 
the largest number of inputs of all clauses. Then, due to the transformation, the number of literals 
and clauses in the RIFFSAT instance increases by at most 2r{n - 2) and r(n - 2), respectively. In 
contrast to that there are 6(r + r(n - 2)) inequalities needed to encode the signaling network in cas- 
cade form compared to (n + n- 2"~^)r inequalities in the IP representation of Lemma|6] Both counts 
leave out binary constraints and fixings. Hence, it is a reasonable tool to reduce the complexity of 
the inequality description. 



So far both approaches, MAXVAR SAT as well as IP, provide one maximal feasible solution. But 
one is interested in all maximal solutions with respect to the requirement variables to find suitable 
intervention strategies or to plan specific experiments verifying an actual network structure. In 
order to find the set of all maximal models (see Definition [2]) or all maximal feasible solutions with 
respect to the y-variables it is necessary to use a 'clever enumeration method'. For this purpose 



we want to make use of the joint generation algorithm (Fredman and Khachiyan, 1996). This 
method checks whether a pair of monotone boolean functions are dual. The problem is equivalent 
to finding all maximal models of a monotone CNF formula. 

Definition 7 (monotone CNF). Let C be a CNF expression and let Z be a subset of the literals L. 
Then C is called down-monotone {up-monotone) in Z if from m*(Z, L\Z) satisfying C it follows 
that m(Z, L \ Z) satisfies C for all m(Z) < m*(Z) (m(Z) > m*(Z)) and m(L \Z) = m*(L\Z). 

An integral set is down-monotone in the vector z if (x, z*) & P leads to (x, z) & P for all z < z*. 
Remark 5. A CNF formula is down-monotone in x if all literals of x have only negative occurrence. 

Note that RIFFSAT is not necessarily down-monotone in y as the next example shows: 
Example 4. We consider the easy RIFFSAT instance 

Z = (A A Ja) V (5 A Jb) ^ C A (yA V js). 

It is not down-monotone in 7 = {y^, Jb} since the truth assignment 

A = \ 5 = yA = l JB=1 C = l 

satisfies Z, while 

A = l B = yA = yB=l C = 1 

does not. 

As RIFFSAT instances are non-monotone in general, we apply a transformation proposed 



by (Kavvadias et al. 2000) to monotonize the requirement variables of non-monotone CNF terms. 
The method preserves the set of maximal models while the general models can differ. Therefore 
the positive y-variables are eliminated according to a recursive resolution procedure: 

1 . Expand the RIFFSAT instance K to CNF form. 

2. Choose a variable yi, that occurs as positive and negative literal in K. 
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3. Divide the clauses into three parts Sy^ U Sj^ UAy^, the set of clauses with occurrence of y^., of 
yk, and no occurrence at all. In this context 'U' denotes a conjunction. We write Kj = (CiVyi,) 
for Ki e Sy„ i = I,..., \Sy,\, and Kj = (Dj V yt) for Kj e Sy„ j = I,..., Thus, d and 
Dj are disjunctions of all other variables apart from y^. 

4. Compute all resolvents of each pair of clauses in 5^^ and Sy^. with respect to y^, i.e. 
Ry, = [iQwDj)\KieSy„ i^y 6 5,,). 

5. The expression = Ry,^ US j.^ UA^^ is monotone in yt, since yk has only negative occurrences. 

Theorem 8 ( [Kavvadias et al.|[2000[ ). With the above transformation it holds that models(K) c 
models(KyJ and maximal(K) = maximal{KyJ. 

Thus, we can apply this concept recursively and obtain a CNF expression which is monotone in 
the y- variables and hence, we can utilize the joint generation algorithm ( Fredman and Khachiyan[ 



1996 1 to compute the invariant maximal models. 



However, it is easy to see that the transformation can lead to an exponentially larger expression. 
But in the case of RIFFSAT instances the number of clauses even decreases. 

Monotonizing the requirement variables in one i?, e R, formula Q reduces the clauses to 

AjeLf ((-^i V -^yj V Bi) A y^eLf V {^y j V ^Bi)) 
« (MjetMi A yj) ^ 5,) A (VyeLf (C A y j) ^ V^eLf ^u) . 

In terms of inequalities this is modeled by 

Xb, >^a, -(1-%, ) . 

xi £{0,1} ^ ^ ^ 

1 =x, + x, ULfu{B,}UY, 



Introducing such constraints for every i?, 6 R gives the monotonized version of ( [RIFFS AT} . We 
denote by Tmon the set of integral points fulfilling ([6]) and thus also (|7]) for each z = 1, . . . , r. 

Lemma 9. The system ([6]), and thus are monotone in y and have the same maximal y-solutions 
as dRIFFSATD and 

Proof. From the inequalities it is easy to see that it is down-monotone in y, since pushing one y 
component to 0, say Xy. = 0, only relaxes both inequalities containing Xy.. In particular, this means 
that the same A and B components are feasible for Xy. = as for Xy. = 1 . In the logic formula one 
can see the down-monotonicity in y by expanding the implications to CNF. All y-variables occur 
as negated atoms. 

To prove the accordance of the maximal solutions we can focus on a single RIFFSAT formula 
\J'U\i^i ^ yi) ^ B A ViLi yi, I = ■ ■ ■ because the y variables are disjoint for every RIFFSAT 
formula and thus the monotonized version of RIFFSAT can be built by monotonizing each formula 
Ri. 
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We will show that the following two integer programs (|V]) and fW) have the same optimal 
solutions with respect to the y components. 



max 2"=i % 
s.t. xb > - (1 - Xy) j el 

<Z,tes-^A, + (l-^v,) + Zi^5-^v, jeS, 0^5c/ (V) 

Xl 6{0,lj 



1 = Xi-\- Xl 



le{Aj,yj,B} 



and 



max YIi=\ % 
s.t. Xb >XAj-{\- Xy) 

Xb <ZLi-^a,+(1- V (W) 

X, 6 {0,1} 

1 =x, + xi le{A,,yuB] 

For an ease of notation we will subsequently use the index / for the variable x/. Let A j and yj denote 
(Ai, . . . ,An) and (yi, . . . ,y„). Let fv and fw be the set of integral points of problem (|V]) and ( fW] ), 



respectively, and let x*^ indicate the optimal solution of problem (L), L=V,W. Then, y*^ denotes 
the corresponding y components. Note that Tv c fw- 

Case 1: If there are no Aj, B components fixed to a certain value, there exists an x*^ 6 'Fi with 
y*L _ J Pqj. example, the vector (Aj,yj,B) = (0,1,0) is feasible for both IPs. Thus the optimal 
solutions are equal. 

Case 2: If some A/, B components are fixed to or 1, there are two critical cases in which there 
exists no x^ e'Fi such that y^ = I for L=V,W. 

The first one is A/ = and 5=1. Here, y*^ = is necessary for both L since the second type of 
inequalities of ( |W] ), which are also valid for (|V]), forces B immediately to if one yj = 1. Thus, 



the optimal values match. 

The second critical configuration is that A, = 1 for i e Ii Q I with Ii d) and Aj = 0, j i h, but 
5 = 0. The optimal y solution is y*^ = for / 6 /i and y*^ = 1, j i h, L=V,W, by the first type of 
inequalities, which is valid for both programs. It forbids to lift another to 1 as this switches B 
also to 1 . 

If Xy. variables are fixed to or 1, it influences both objective values equally. Thus, the objective 
value of the integer programs (|V]) and ( fW] ) coincide in every possible case which concludes the 



proof. □ 

Lemma 10. The inequality system (|7]) describes cony{Tmon) when substituting {0, 1} by [0, 1]. 

A proof for the Lemma can be found in the Appendix. Note that the system (|7]) are even a facet 
description for conv(!Fmo«) as the inequalities (|5]) are facets for conv(!F) and all feasible points are 
preserved. 

The LP relaxation of a monotonized dynamic IP (|7]) containing more than one formula, i.e. 
r > 2, is not integral in general as the following example shows. 

Example 5. Consider the monotonized version of the dynamic IP (|7]) of the signaling network from 
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A^C 
B^C 
C ^ D 
-^D ^ E 
E ^ A 
F 

G ^ B 

Figure 3: A signaling network with two negative feedback loops from Example |6j The dashed line 
denotes inhibition. 

Example [3j Its linear relaxation is the following polyhedron 





xi-(\- 


-yi) 


< X4 


X2-(l 


-yi) 


< 


X3 


(1 


-x,)-(\- 


- Js) 


< X4 


X4 - (1 




< 


X3 


+ (1 


-x,) + (l- 


-yi) 


> X4 


X2 + X4 + (1 


-yi) 


> 


Xi 


+ (1 


-x,) + (l- 


- J3) 


> X4 


X2 + X4 + (1 




> 


Xi 




< 


Xi,yi 


< 1 for / 


= 1,...,4 









This polyhedron is not integral, since e.g. (x, y) = (1/2, 1, 1/2, 1/2, 1, 1/2, 1, 1) is a vertex. But it 
also has integral vertices like (0, 0, 1, 0, 1, 0, 1, 0) so that it is not infeasible. 

To illustrate the use of the dynamic model we give a small example of a signaling network. 

Example 6. Consider the network defined by 





>xa-(1 -Ja) 




Xa 


> 


Xe - (1 -yE) 




xc 


<xa + (1 -Ja) 




Xa 


< 


Xe + (1 - yE) 




Xc 


>xb-(1 -ys) 




Xf 


> 


Xd - (1 -yD) 




Xc 


<xb + {\ -ys) 




Xf 


< 


Xz) + (1 - yD) 




Xd 


>xc-{l - yc) 




Xg 


> 


{\-Xe)-(\- 


yp) 


Xd 


<xc + {\-yc) 




Xg 


< 




yp) 


Xe 


> (1 - Xd) - (1 


-yn) 


Xb 


> 


Xg - (1 - yc) 




Xe 


< (1 - Xd) + (1 


-yo) 


Xb 


< 


Xg + (1 - yc) 





xi,yie {0,1} -il 



which is illustrated in Figure |3j As there are two negative feedbacks involved, using the static 
approach leads to infeasibility. Thus, we are interested in the dynamics like possibly late reactions, 
i.e. in maximal feasible subnetworks. In this case there are different possibilities to disturb the 
cycles. One can either set yc = and the rest to 1 or cut two disjoint arcs each in one cycle, 
e.g. yE = and yc = 0. The remaining variables can then be 1. With this guideline and precise 
experiments the practitioner can then identify how the network structure actually looks like. Of 
course, the obtained y values also give hints at suitable intervention strategies. 
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Remark 6. Note that one can also model timing information using the RIFFSAT formulation: Let 
T 6 Z+, a time horizon, be given. Then, for every t e {I, . . . ,T} we have different signaling 
networks, because of distinct reaction times. Due to these delays it is possible for a molecule to 
be absent at one point ti, but to be present at tj. This can be modeled by T copies of the same 
networks but each with a different y' vectors t = I, . . . ,T, which imply absence or presence of each 
interdependence in the biological unit at time point t. Each y' vector is according to Equation ([5]). 
In this setting the changes of the signaling network over time is encoded by the difference of two 
consecutive y' vectors, y' - y''\ t > 2. 

Our proposed approach is also able to handle extra information about the structure of the net- 
work over time. Such information can be statements like if an interactions is present at time point 
f, it is present for all ? > f , or an interaction is only valid for exactly one t e {I, . . . ,T}. It can be 
expressed in terms of logical formulas/inequalities over the y'. 
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cols rows 


inputs 


outputs 


#feas 


#infeas 


total time (s) 


avg time (s) 


214 376 


3 


14 


36 


131036 


« 120 


0.001 



Table 3: In/Out fixing of TCR from ( |Saez-Rodriguez et al.[|2007| ). 

5 Computations 

We have tested the ideas presented in this paper on the TCR-signaling network 

from ( Saez-Rodriguez et al.[ 2007| ), as well as several randomly generated signaling networks. To 



demonstrate that the integer programming formulation is in fact useful to test feasibility of scenar- 
ios (on the full model or in knock-in/knock-out tests), we performed several tests: Table |3] shows 
feasibility tests for all possible combinations of input/output values in the TCR model. Computa- 
tions were performed using CPLEX 9.1 and Allegro Common Lisp 8.1 on a SUN-Fire-V890 with 
1.2 GHz. Even though the IPs do not generally reduce to an LP description, the whole instances 
could be solved within two minutes. 

Due to the lack of real instances we generated three types of random signaling networks which 
are built with different probability distributions so that each has a distinct structure. For tech- 
nical reasons we deviate slightly from the standard form of a signaling network: we construct 
IFFformulas of the form Vyey^; ~^ B (OR-clauses) and /\jejAj B (AND-clauses). All types are 
constructed according to the following procedure: 

1. Set the number of components n and operation nodes m and fix the proportion of AND- and 
OR-nodes A/0. In our random types A/0 will always be equal to 0.5. 

2. Determine, with respect to A/0, which operation nodes are AND- and which are OR-nodes. 
Therefore the realization of a random variable X which probability distribution reflects the 
ratio A/0 is generated. Clearly this means, P{X = AND) = A/0 = 1 - P(X = OR). 

3. List all components from \ to n. 

4. Let cii be the number of inputs of operation node i = 1, . . . , m. Determine a, as a realization 
of A, with A, ~ R with some probability distribution R. Note that R changes for the different 
generated types. 

5. Choose the input and output components for each operation node separately by generating 
the realization kof a random variable K, which is uniformly distributed on the set { 1, . . . , n}. 
The resulting number k refers to the index of the components. If a component is selected 
more than once, the duplicates are deleted leading to a smaller input degree. Note that for 
the selection of the output component of operation node z, the input components of i must 
not be taken into account. 

6. Decide ifStorSkis, assigned as an input, with a random number taking two equally probable 
values. 

For the first type of random networks, we generate the number of inputs according to a 
X^j' - distribution. The parameter of this distribution /, the degrees of freedom, equals the mean of 
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10-5a 10-5b 20- 10a 20- 10b 100-50a 100-50b 100- 100a 100- 100b 



# subs 


10 


10 


20 


20 


100 


100 


100 


100 


# ops 


5 


5 


10 


10 


50 


50 


100 


100 


min in 


1 


1 


1 


1 


1 


1 


1 


1 


max in 


5 


5 


6 


7 


15 


9 


11 


12 


avg in 


3.2 


3 


3 


2.6 


3.96 


3.44 


3.27 


3.48 


# sources 


6 


5 


7 


6 


38 


30 


33 


34 


# sinks 


1 


1 


2 


3 


6 


5 


3 


2 


# variables 


26 


20 


40 


46 


208 


214 


252 


262 


# rows 


38 


30 


58 


63 


354 


335 


566 


599 


time (sec) 


0.010 


0.000 


0.000 


0.000 


0.010 


0.010 


0.010 


0.020 


# B&B nod 


























feas/infeas 


f 


f 


f 


f 


f 


f 


f 


f 



Table 4: Overview of the properties of type I networks, which are specified by number of compo- 
nents - number of operations. We always generated two networks, a and b, of the same size. 



Aj. Hence, we set A, to be distributed with three degrees of freedom in order to derive a 'lean' 
signaling network similar to the TCR network with three inputs per operation node on average. Re- 
sults are displayed in Table|4] The number of molecules is denoted by '# subs', '# ops' denotes the 
number of AND/OR operations used and 'min/max/avg in' means the minimal/maximal/average 
number of elements on the left hand side of all IFFSAT formulas St. The number of inputs and 
outputs to the network are stated as 'sources' and 'sinks'. The size of the IP is depicted in the 
following two rows. The IPs could be solved very fast even in large cases and without any branch 
and bound nodes used. The number of paths between sources and sinks is relatively large, there 
are, e.g., 14, 15, 33 and 21424 paths. 

Additionally the shortest path between sinks and sources has length 2, even in the large net- 
works. This is not a realistic network structure. To avoid this feature we force the network to hold 
more layers. This is done by generating several type I networks, such that the sinks of the previous 
network are the sources of the next one. Type II networks contain three Type I networks glued to- 
gether, which is reasonable as the shortest path in the TCR model is 5. Type II networks are similar 
to the real model with respect to input degree number of paths and path length. Computations are 
hsted in Table |5] and are as fast as in the Type I case. The number of paths from input to output 
layer decreases to 2, 1, 11, 422 and 9243, while its average length increases. Note that the number 
of components and operations characterizing the different networks diff"er from the entries in the 
table since they specify the amount of components and operations in each Type I network. 

After the first two types were constructed similarly, the third type is generated distinctly. We 
set R := U[l, 15], i.e. A, is uniformly distributed on the interval [1, 15]. To obtain integral input 
degrees, the generated random number is rounded up to the next integer. This results in an average 
input number of eight. Hence, the networks have comparably many arcs and are more or less 
'thick'. The number of paths between sink and source are like in Type I networks quite high, e.g. 
24, 51, 26 494. In Table[6]the computational results are displayed. 

Next, we employed the joint-generation method ([ Fredman and Khachiyan[ 1996) as imple- 
mented in ( Haus[ [2008 ) to compute all minimal infeasible and maximal feasible vectors y. The 
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5-la 


5-lb 


10-5a 


10-5b 


30- 10a 


30- 10b 


50-25a 


50-25b 


# subs 


15 


15 


30 


30 


90 


90 


150 


150 


# ops 


3 


3 


15 


15 


30 


30 


75 


75 


min in 


1 







1 














max in 


3 




6 


6 


5 


8 


8 


9 


avg in 


i.O/ 




i.O 


T 87 

i.O / 


Z. i J 


Z.l J 




L."rJ 


# sources 


2 




8 


4 


12 


14 


30 


29 


# sinks 


1 




4 


2 


2 


5 


10 


13 


# variables 


30 


30 


64 


74 


184 


184 


318 


322 


#rows 


22 


22 


74 


70 


186 


186 


428 


429 


time (sec) 


0.000 


0.000 


0.000 


0.000 


0.010 


0.010 


0.010 


0.010 


# B&B nod 


























feas/infeas 


f 


f 


f 


f 


f 


f 


f 


f 



Table 5: Overview of the properties of type II networks, which are specified by number of compo- 
nents - number of operations. We always generated two networks, a and b, of the same size. 





25-5a 


25-5b 


50-lOa 


50- 10b 


100-20a 


100-20b 


150-50a 


150-50b 


# subs 


25 


25 


50 


50 


100 


100 


150 


150 


# ops 


5 


5 


10 


10 


20 


20 


50 


50 


min in 


3 


2 


1 


1 


1 


1 


1 


1 


max in 


9 


10 


13 


10 


14 


13 


14 


14 


avg in 


6.2 


7 


6.3 


4.8 


7.2 


7.6 


7.24 


7.1 


# sources 


11 


9 


20 


13 


42 


42 


75 


73 


# sinks 


1 


2 


5 


2 


6 


4 


4 


2 


# variables 


50 


50 


100 


100 


200 


204 


306 


308 


#rows 


65 


61 


123 


108 


263 


277 


568 


561 


time (sec) 


0.000 


0.000 


0.000 


0.010 


0.000 


0.010 


0.010 


0.010 


# B&B nod 


























feas/infeas 


f 


f 


f 


f 


f 


f 


f 


f 



Table 6: Overview of the properties of type III networks, which are specified by number of com- 
ponents - number of operations. We always generated two networks, a and b, of the same size. 
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TCRB CD4 CD28 max feas min infeas # oracle calls time 

# max avg min # max avg min 












1 


324 


324 


324 











1 











1 


1 


322 


322 


322 


2 


323 


323 


323 


974 








1 





1 


322 


322 


322 


2 


323 


323 


323 


974 








1 


1 


1 


320 


320 


320 


4 


323 


323 


323 


1619 





1 








2 


323 


322.5 


322 


2 


322 


322 


322 


1298 





1 





1 


2 


321 


320.5 


320 


4 


323 


322.5 


322 


1943 





1 


1 





2 


321 


320.5 


320 


4 


323 


322.5 


322 


1943 





1 


1 


1 


2 


319 


318.5 


318 


6 


323 


322.3 


322 


2584 






Table 7: Computation of minimal infeasible and maximal feasible vectors y on the TCR model 



from (Saez-Rodriguez et al. , 2007): Comparison of the cardinalities and computation time, and the 



support of the 324-dimensional vector of variables for all 8 patterns of input signals. All timings 
below measurement threshold of 10ms. 

feasibility oracle employed in this algorithm is solving integer feasibility problems of the form ([5]). 
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A Appendix 



Proof of Lemma 10 Without loss of generality let / = {1, . . . ,n} implying the RIFFS AT formula 
yUiAi A yd ^B^YUyiJ = {\,...,n}. Thus, let 



^mon — 



( S. \ 



eiOAf""-' ■.B>Ai-il-yt) V/= l,...,n 

n 

B< Y^Aj + (l-yd V/=l,.. 



and 



P = 



' A ^ 

y 
5 ) 



6[0,l]'"+^5>A,-(l-3;,) V/= l,...,n 

n 

5< 2a,. + (1-3;,) V/=1,.. 



We need to show that P = conv(?^„„„). It is clear that conv(y^„o«) ^ P- For the converse, assume 
that P has a fractional vertex f = (A, y, B). Since for a vertex 2n + I inequalities have to be tight, 
f has at least one integral component (there are only 2n inequalities without box conditions). Let 
nfhe the number of fractional components of f; < nj < 2n. It is to show that nj > gives a 
contradiction. 

Let ki be the number of tight inequalities of the first type and ^2 the one of type two inequalities, 
ki + ki = Hf. Ij denotes the corresponding equality index set of type j = 1, 2. To show the Lemma 
we will distinguish between three cases: 

(i) fci > A ^2 > 0, 

(ii) ki = Hf > A k2 = 0, 

(iii) ki = A k2 = Hf > 0. 
Case (i): Let luhi" 

Since B = 2"=i + (1 - yd for all I e I2, yi must have the same value for all / 6 I2. Additionally, 
for i 6 /i and / 6 /2 it holds that 



Ai-(l-yd = rj=iAj + (l-y,) 



O = Z;,,A, + (l-);0 + (l-y/)- 



Since all variables are non-negative, we find that Aj = j i, y^ = = 1 VZ e /2 and A,- = 
B. Thus, A/\|,) = 0, y/,u/2 = 1 and the only possible fractional components of f are yj for j e 
/ \ (/i U I2) = {/i, . . . ,4} and B = A,. But if they are fractional, we can construct a convex 
combination of integral points in Tmon, because the variables are all strictly between and 1 and 
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all possible 0/1 combinations of the fractional variables are feasible points. For this purpose let 
w.l.o.g. the fractional j/\(/iu/2) be ordered so that j/, < . . . < < B < yi^^^^ < .. . < yi^, and let 
= Zies , S c I, where ef is the i-th unity vector on the A-variables and the remaining n+1 
components are 0. is analogously defined; e {0, is the unity vector of B. Then the 
convex combination for f is 

f =yi,(ef + \] + es) + (yi, - yi^){ef + v];^,,^, + ee) + ■ ■ ■ + (B - yij 

If several components have the same value, this construction reduces them to one convex multipli- 
cator, i.e. in the next vector they will all occur as 0. Thus, f is no vertex of P. / 

Case (ii): Let /i = {I, . . . ,ki} and h = d). 
The number of integral components of f must be greater or equal to n + 1, because n/ = ki < n. 
Thus, there exists an index j e Ii such that the equality B = Aj - (I - yj) contains at least two 
integral variables. Thus, all contained variables are integral and in particular B is integral. In the 
equalities where only B is known to be integral, say B = Ak - (I - yk), k G h, A^ and yk can be 
fractional. There are two cases to be considered: 5=1 and B = 0. 

B=l: :1 = A,- - (1 - Vi e /i <^ 2 = A,- + j,- :A,- = y, = I. Thus, the only fractional 
components of f can be A/\/j and y]\j^. As 5 = 1 and Aj = y, = 1 for all / G 7i, there is a 'reason' 
for B being 1. Therefore the fractional components can be convexly combined as in case (i) since 
AJ\J^ and 3;/\/i can be any 0/1 combination to complete a feasible point for P. Hence, f is no vertex. 

L 

B=0: :A, = \ -yi Vi g li. Let {p\,.. .,Pm} = l( ^ h denote the index set of the fractional A- 
variables in Ii and thus their corresponding y-variables, which also have to be fractional according 
to the equality. For j e I \ Ii the inequalities imply that Aj +yj < 1. We proceed similar to the 
previous case. W.l.o.g. assume that A, < V/ g and that Apj < yj^ < Ap^ < . . . < Ay^ < y^, < 
Ap,_ , with ji G I \ = 1, . . . , /, are the ordered fractional components. For ease of notation we 
will leave out the integral A, and yt, i e Ii \ l[ and consider only the remaining components f*. 
Accordingly, , and eg are adjusted to the new dimension. Then, 

^A/iufp.)\u.)) + • • • + - + v^,^, . ,) + {yn - ^.o^^/u,,,, + cvp. - yp^K{- 

The vectors used in this representation are all elements of P. Furthermore the convex multiplicator 
sum up to 1, as A, + = 1 for / G l[. Thus, f is not a vertex. / 

Case (iii): Let /a = {1, . . . , ^2} and /i = 0. 
Analogous to case (i), it follows that yi = . . . = y^^. We also know that there are = ^2 fractional 
components of f . 

If these fractional components are y,, / G I2, the other variables are all integral. But the equality 
B = Xy=i + (1 - yd for all i e h and the integrality of all involved variables but yield that 
yi G {0, 1} Vi G I2 and therefore f is integral. 

Thus, yi must be integral for all / G /2. We need to distinguish between 6 cases: 
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a) A, for / G c / is fractional QI'^l = ^2), 

b) yi for iePcl\l2is fractional (\P\ = ki), 

c) B,Ai, j € 7^ c / are fractional (|/^| =k2- 1), 

d) B,yi, / G P' c 7 \ 72 are fractional (\P\ =k2- 1), 

e) Ai,yj, / G 7^ c 7, 7 G P' c 7 \ 72 are fractional (|7^| + \P\ = ki), 

f) B,Ai,yj, iel^ c 7, j e P c 7 \ 72 are fractional (|7^| + |7>| =k2-l). 

The case where only B is fractional does not have to be considered as equality in at least one type 
two inequality immediately forces B to be integral, as well. 

a) With the equality it also follows that 2,g/A A, 6 {0, 1}. 

• i:,-,/AA, = 0:A; = 0VjG7'*. / 

• A; = 1.5 = + (1 - yi), le h-.B = l,Ai = 0,ie I\I^,yi = h. As 
B = 1, we only need one A,, z 6 7^* to be 1, independent of the y pattern, for a feasible point. 
Let = {ii, . . . , im}, then f can be convexly combined by 

f = A;,(e^ + v^^ + + Cb) + • • • + Aijel + ^1 + + eg) 

for the subset 5 of 7 \ 72, where yj = I. Since we know that H,6/-* A/ = 1, we have a real 
convex combination. / 

b) As P' n 72 = 0, Z •=! Aj + (l-yk) = B< Z%i Aj + (1 - yd, i e P : yi < yk for all k G 72. 

• = for G 72 -.yi < for i e P. f 

• 3;^ = 1. Thus, either B = = Ai = . . . = A„ or (w.l.o.g.) 7? = 1 = Ai, A2 = . . . = A„ = 0. 
In both cases, we can choose any yp pattern to get a feasible point in P. Therefore, one can 
follow the same procedure to construct a convex combination of integral points as in case 
(i). / 

c) Again, equality implies B - J^i^ja A; G {0, 1}. 

• B- Ziei'^ A, = 1 : 5 = 1, A, = 0, / 6 7^. / 

• B - Y^iei^ A,- = o = Aj + {\- yu) V/: e 72 

:Aj = 0, j i and yk = k ^ h- Additionally, yj e {0, 1} for j £ I \ I2 and for a subset 
S Q IXhyj = 1- Then we can convexly combine integral elements of P to obtain f . For this, 
let 7^ = {/i,...,U: 

f = A,-,(e^ + v)^ + + es) + • • • + A,-„(ef^ + V,^ + v^^ + Bb) + (1 - 2,,,^ A,-)(v^^ + v^^) 
Therefore, f is no vertex. / 

d) Since B = Y/j^^ Aj + (l - y^), k e h and all variables involved except for B are integral, B 
must be integral as well. Hence, we are in case b). / 

e) As shown in case b) it follows that yi < y^ for all i 6 P and A; G 72 and with this yk= l^k e I2. 
This implies that B = 2"=! Aj and hence ^^^ja Ai G {0, 1}. 
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• Z/e/'t^i = : A; = V/ 6 I^. The only remaining fractional components are yj, j € P. The 
possible cases for the integral components are analogous to case b) and they can be convexly 
combined as in case (i). / 

• Zis/'i ^( = 1 : Ai = i ^ , B = 1, = I, j & h- We again want to apply the scheme used 
in case (i), i.e. look for the minimum within the fractional components, set all fractional 
components to 1 in the convex combinator, multiply it by the lowest value, then take the 
minimal difference between the fractional entries and the previous minimum, set the com- 
ponent of the previous minimum to and multiply it by the difference of the two. For this 
purpose it is necessary to make sure that there is always at least one A,, / e Z'*, that is one in 
the convex combinator. This can be achieved by adjusting the system a little bit to a combi- 
nation of the procedures of case (i) and case (iii), a): We set only one A,- at a time to 1 until 
its value is reached and then the next becomes 1. For the y components an arbitrary pattern 
can be chosen. For an easier description assume that = {/i, . . . , im}, P = {71, ... , jk) and 
Ai^<yj,<A,^<...: 

f =\(4 + + ^/>' + es) + (yh - ^'•i)(ef2 + + ^/^ + ^s) 
+ (Ai2 - yn)K + "^l + '^/ni;i) + es) + • • • 
Since X/e/-* = 1 it follows that the constructions yields a real convex combination. / 

f) In this case one can construct a convex combination of f by using a combination of the cases 
e) and c). / 

In a all cases the fractional vertex f could be convexly combined and thus can not be a vertex. This 
implies P = conv(;Fmon) □ 
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